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ABSTRACT 

Validity and reliability data are presented for two 
instruments for assessing the predispositions that people have toward 
the use of assistive and educational technologies. The two 
instruments, the Assistive Technology Device Predisposition 
Assessment (ATDPA) and the Educational Technology Predisposition 
Assessment (ETPA) , are self -report checklists with a consumer form 
and a version to be completed by professionals. The instruments are 
designed to identify for consumers of technology, their families, and 
advocates likely sources of mismatches i»tween the user and the 
technology. Criterion-related validity was assessed for the ATDPA by 
asking 12 older adults with hearing loss and 6 members of a 
continuing education group to complete the instrument anc. a batterv 
of 8 other tests. Results suggest the ATDPA 's value in assessing 
factors involved in device use. The criterion-related validity of the 
ETPA was supported by results with 52 college students (26 hearing 
impaired) , including an evaluation or hypercard use. The interrater 
reliability of the ATDPA was studied with 30 professionals rating 3 
potential users, and that of the ETPA was studied through responses 
of 24 raters (music education undergraduates) rating 2 potential 
users- Both instruments seem to do a good job assessing the 
predispositions toward technology use of potential consiuners. Six 
tcibles present study findings. There is a three-item list of 
references and an appendix containing the interview questions for the 
ETPA criterion-related validity study. (SLD) 
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Early Validity and Reliability Data for Two Instruments 
Assessing the Plredispositlcms F^le Have Tciward Technology Use: 
Continned Integration of QuantitatiTe and Qualitative Methods 



The tise of both educational and assistive tedmolog^es in a wide variety of edvcationa) settings has increased 
exponentially in fl\e past few years* For example, IDEAr or Individuals with Disabilities Education Act of 
1990 (formerly the Education of die Handic^ped Act), now explicitly includes assistive technology as an 
area to be considered when developing a child's Individual Education Ran (lEP), A need for assistive 
technology devices must be considered along witfi the diild's other educational needs and it must be 
identified on an individual basis. Cost and/or lack of availability of equipment cannot be used as an excuse 
for denying an assistive technology service and parents have *he right to appeal if assistive technology 
services are denied. Posteecondary students must be provided "reasonable accommcxiations" according to 
Section 504 of the Rehabilitation Act of 1973 and employees of educational institutions are protected under 
the Americans with DisabUities Act, The term "reasonable accommodations" for persons with disabilities 
frequently means the provision of asstetive technologies. 

The definition of instructional and educational technologies vary in the literature from: 

* electromechanical or computerized means of instructional deliveiy (e.g. hypercard stacks, 
telecourses) 

• the process of developing and designing instruction according to cognitive psychology and learning 
theory. 

Thus, technologies can range from what is written on the blackboard, to overheads and handouts, to 
hypercard stacks and telecourses. For the purposes of this paper, we are assuming the former definition 
and that educators desire to better match individuals with electromechanical or computerized technologies. 
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Tm Imtaoncnts Asse^ing Tedinology Use 3 
In all levels of education, for students widi or wiAout disabilities, sudi educational tedmoio^es as 
coonputer tutors and telecourses have e7<})anded the options for addressing individual students' particular 
learning styles and needs. It is, Oterefore. becoming increasingly important to be able to undetstand the 
cKffeiences between those who successfully employ technologies and those who avoid or abandon their use. 

An eariier AERA paper (Schezer & McKee, 1991) discussed the value of integrating quantitative and 
qualitative methods using a FartidpatOTy Action Researdh design to develq> two imtruxnents assessing tiie 
quality of Ae match between an individual and a particular technology being proposed for tfiat person's use. 
Both instruments are self-report diecldists wid\ a (x>nsumer form (items were identified by individuals with 
disabilities) aiul a version designed to be OMnpleted by professionals. Items are of varied format, including 
5-pointIJkert scales and checklists. The two instruments, the Assistive Technology Device Predisposition 
Assessment (ATD FA) and the Educational Technology Predisposition Assessment (ET PA) each have four 
subscales so tihat characteristics of the technology, the individual's temperament, and the environment in 
which the person will use the technology can be separately assessed. The purpose of the instruments is to 
identify for consumers, their families, and advocates die likely souTce{s) of person and technology 
mismatches so that steps to facilitate a match can be taken (see Figure 1). Shared perspectives between 
consumer and professional can be assessed by comparing the resporwes each makes to the items on their 
version of the ATD FA or ET PA. 

The two most immediate concerns regarding the instruments are the extent to which they adequately assess 
the myriad influences on technology use (content and criterion-related validity) and, since the instruments 
are comprised of items requiring subjective judgements, the effect of "scorer variance" (inter-rater reliability). 
The description and results of the initial efforts employed to address these concerns fonn the primary 
objective of this paper. 

METHODS AND DATA SOURCES 
Methods used to develop the instruments are described in detail in, m<Mt recently, Scherer and McKee (1991, 
1990) and Scherer (1991). Briefly, the methods and data sources described h »re are limited to information 
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Two Instruments Assesring Tedmology Use 3 

ooOected to assess the izistnunents' criterion-rdated validity and data regarding the inter-rater leltafniity of 
die two instruments. Sirce the ATD PA and FT PA were created bxm the actual experiences of people who 
used or did not use a techntdogjr provided to them, and on-gcnng discussicms with consumers and 
professionals in die field as well as omtinuous reviews of the literature aU tend to suppOTt tihe items 
induded, Hie instruments have adequate content validity . 



Cfiterion-Related VaMditv. ATD PA 

Members of die Rodiester area organization, Self-Help for tfre Hard-of-Hearing (SHHH) were asked to 
onnplete the ATD PA and several otfter instruments regarding tiheir predispositions to tite use of assistive 
listening devices. For the most part, people who are active in SHHH wear hearing aids and use a variety 
of ALDs. The mean age of the active members of diis group is around 6U. 

The membership of an organization dedicated to the continuiitg education of <^der adults was also asked 
to complete tfie ATD PA regarding their use of assistive listening devices. None of die individuals in this 
group wear hearing aids or use ALDs, but all have a demortstrated hearing loss. The mean age in tiiis group 
of persons is approximately 65. 



Each indi^ddual was asked to complete a battery of tests which induded the following instruments: 
Hearing Handicap Inventory for the Bderly - Screening Version (10 items, 1 total score) 
Rotter's Locus of Control Inventory (29 items, 1 total score) 

Health-Promoting lifestyle Profile (Walker, Sechrist & Pender, 1987) (48 items, 6 subscale scores) 
Perceived Health Status (sum of 3 items) 

Multidimensional Health Locus of Control (Wallslon & Wallston, 1978) (18 items, 3 subscales) 

Self-Performance Survey - Longer Version (Wallston, 1990) (a perceived competence measure) (total 
score) 

Health Value Survey (Wallston) (rank order of 10 values) 

The Communication Profile for the Hearing Impaired (Demorest & Erdman, 1984) (145 items, 27 
subscales) 

Assistive Technology I>evice Predisix>sition Assessment (Scherer & McKee, 19W) (44 items, 
4 subscales) 



ERIC 



Two Instniments Assessing Teehnologjr Use 4 

The members of SHHH and the continuing education organization, while similar in age, differ in degree of 
hearing impairment and need for ALDs, with fte SHHH members having more hearing loss and need for 
assistive listening devices. The pmpc^ of tiie xeseardi was to explore tfie personal, health, cmnmunication 
and psychological differences between tfte two groups (contrasted groups design) and to determine the best 
measures to use in futune attempts to distinguish potential users of assistive listeniztg devices from non- 
users. 

Criterion-Related Validitv; ET PA 

Telecourse satisfaction. Two pilot tdecourses were offered Fall, 1991 with students and faculty at Rochester 
Institute of Technology and Gallaudet University. The course, '^laclc OvO Rights in flie Twentieth 
Century," was taught by a RTT history professor with a Gallaudet "resource" or co-teacher. A professor at 
Gallaudet University taught "Mass Media and Deaf History" with a RTT faculty member as "resource 
teacher," The resource teadters were to facilitate student access to and utilization of the delivery system; 
they were not to provide instruction per se. Botfi courses were open to students at Gallaudet Universitj J 
Rochester Institute of Technology/National Technical Institute for tfie Deaf. The maximum student 
eru-ollment for each course was set at 26, with the goal of having equal numbere of Gallaudet and RTT 
students enrolled in each coiu^e. 

The instructional delivery involved captioned videotapes and movies, assigned readings using a variety of 
print materials, and class discussions via computer conferencing technology (electronic mail over Internet). 
Students had computer access days, evening, and weekends. Students were given an orientation prior to 
the beginning of the course on how to use Internet. All assignments were read and graded through the use 
of electronic mail. 

At the end of the course, studente from each institution were asked to complete a course evaluation as well 
as participate in an interview regarding their satisfaction with the method of irwtructional delivery (the 
interview protocol is in Appendix A), The interviewer was a graduate student who had been given training 
in interviewing skills and who had excellent sign language skills. The interviewer was also asked to 
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provide leedbadc summarizing die infonnation gained torn d\e student interviews. Students who were 
interviewed also completed tiKe Hleamer chazacteiistics'^ pwtion of tfte Edocatlmial Technologies 
Rredisposition Assessmoit (ETPA) (Scherer, Y<»mg & McKee, 1990). Additionally, comments, insights, and 
recommendations regardii^ die delhreiy system were scdicited item die two primary £aculty for die courses. 

Satisfaction widi instruction delivered by hypetcard . A hypercard stack was created to augment an existing 
instnictor-based, lectuxe/discussion course t^fered to first year deaf NTDfRU science majors in need of 
improved study sJdUs. The hypercard stack offers a self-paced mediod of instructional ddivexy. One 
module. Test Taking, was pilot tested widi all 9 students enrolled in die Fall, 1991 science department 
Freshman Seminar. Evaluation sessions were conducted one^-one and involved die students' use of die 
hypercard stack. The computer screen was videotaped, showing cursor movements and choices as students 
moved through die stack. Students were int^viewed during dieir navi^tion of the stack regarding their 
satisfaction with die system and ways it could be improved. Following this, students cwnpleted a 
satisfaction cjuestionnaire (see Appendix A). One week later, students completed die learner 
characteristics'' portion of the ET PA. 

Intef-tater Reliability: ATP PA 

During a workshop on sensory devices presented at the 1990 Annual Conference of RESNA (an 
interdisciplinary association for the advancement of rehabilitation, assistive and educational technologies) 
30 participants (all of whom were professionals or graduate students in such fields as rehabUitation 
engineering, pediatric medicine, speedi and physical therapy) were shown three videotaped interviews with 
individuals considering using an assistive technology. Additional information concerning the individuals, 
the technology under consideration and dieir physical needs was given to the participants in writing- The 
three case histories included: 

• a deaf, female, college student considering the use of more powerful, but larger and more 
visible hearing aids; 

• a 10 year old visually impaired boy considering the use of a computerized reading machine; 

• a 39 year old quadriplegic male believed to be in need of hearing aids. 
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The workshop participants were aD aslced to complete the ATD PA for eadi of the three cases and were 
interviewed as a group about their experiences with the insttument as a vdiole and with individual items. 



Inte^raler Reliability; ET PA 

Twenty four music education under^graduate students in an educational psydiology course were shown two 
videotapes of interviews of students conadering using a particular educational tedmology. Again, 
infocmation not available fnsn tite videotape was supplied in writing. The case histories presented to the 
psychology students induded: 

* a 10 year old visually impaired boy given a software program for rhythm training; 

* a female hearing-impaired allege student learning to play ^e piano and provided with a 
computer tutor for musical notation. 

Again, the students were asked to complete the ET PA for each of the two case studies. Item modes were 

calculated for all items and the difference between the mode and the individual raters' response was 

computed. Since we were only interested in differences from the mode, the sign. This array of difference 

scores allowed us to calculate an "average difference score." Years ago, a similar statistic based on the item 

mean, was called the mean deviate. Although, the mean deviate has some disadvantages when used in 

place of a standard deviation and hence is seldom used now, in this particular case, what we are calling the 

"average deviation from the mode" seems to be a logical and useful statistic. We were interested in the 

number of raters who chose the same or similar response for a given item for each case study. The closer 

the average difference score is to zero, the more consistent were the raters' judgements of the characteristics. 



In Summary, the following data sources were used to asses the reliability and validity of the two 
instruments under discussion. 



Content Validity 
Criterion-Related Validity 
Criterion-Related Validity 

Inter-rater Reliability 
Inter-rater Reliability 



ATD PA and ET PA Ongoing discussions with professionals in the field 
ATD PA Comparison of ALD users and non-users 

ET PA 



ATD PA 
ETPA 



Satisfied and dissatisfied telecourse students 
Satisfied and dissatisfied hypercard students 

30 Raters each rate same 3 ATD potential users 

24 Raters each rate same 2 ET potential users 
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RESULTS 

Critgrion-Rdated VaUditv: ATP PA 

Twelve members of SHHH and eight members of the continuing education organization completed the fall 
battery (rf assessment instruments. I^ce die number of individuals is small (a total of 20 resfxmdents), tfie 
data aiialysis is descriptive only. TaMe 1 reports tfie group means and t statistics of tfiose itmis and 
subscales for which ttie mean responses of the two groups differed signifJisantSy. As can be seen in Table 
1, only two of die nine asses^Gnent instruments remitted in significant mean differences: Four of die 27 
subscales of The Communication Fkofile for the Hearing Impaired (CPHI) and Shree of Ae i " • subscales 
of the ATD PA. The four CPHI subscales are: Communication performance at hcrnie, communication 
performance under adverse listening conditions, maladaptive behaviors when experiencing communication 
difficulty, and verbal strategies for managing commuxu'cation difScul^. Of the nine instruments, ^e CPHI 
and ATD PA most directly addi^sed personality and psychosocial aspects of hearing loss (and, in the case 
of the ATD PA, of using assistive listening devices). Thus, the CPHI and ATD PA togedier suggest value 
in assessing the personality and psychosocial factors involved in device use. 

Responses to the ATD PA indicate that the technology users (SHHH members) attribute more value to 
assistive listening device use than the members of the other group, are psycholc^cally ready to adopt 
technical assistance, and perceive few difficulties with technology use around family, friends, and at work 
or school. SHHH respondents reported a great deal of perceived benefit to device use, a belief that device 
use will enhance their quality of life, and a view of devices as important in achieving dieir goals. The 
members of the continuing education organization reported the opposite. SHHH members also reported 
more perceived hearing loss than did the members of the continuing education o^ani'ation, whidi is 
consistent with the audiometric data obtained from the respondents. 

The SHHH members reported more maladaptive behaviors on the CPHI. but that may be attributable to their 
responses favoring the avoidance of problem listening situations. While the authors of the CPHI view this 
as "maladaptive," it is a philosophy of SHHH that members avoid situations or envirorunents tfiat are not 
conducive to their participation and where "verbal strategies" alone are not effective. 
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Criterion>R€lated VaUdity: ET PA 

Telecoiirse satisfaction . The knowing results are based on surveys and interviews with a Umited number 
of students. Ten students were interviewed, and d^t returned end-of<ouxse student rating fbnns. It is 
also important to note that flte majority of Ae students who participated in tfie interviews were not on ihe 
same campus as the instructor only one RTF student enrolled in Black OvU Rights in Ihe Twentieth 
Century was interviewed, and no Gallaudet students enrolled in Mass Media and Deafoess were 
interviewed. Finally, only one of the ten interviewees was hearing and we were not aWe to contact any of 
Jtxe students who dropped out of either of the courses. Thus, Ae results should be interpreted with caution. 

Three students were identified as having been dissatisfied with the instructional delivery system based on 
the interview data (see Table 2). It must be remembered, however, that all students interviewed completed 
the course; we do not know the factors that were involved in student decisions to withdraw from the 
courses. 



Both faculty and students who enjoyed die courses agreed that a major strength of the ddivery system was 
the flexibility and control over the use of time afforded die student. However^ those students who were not 
satisfied with the delivery system did not perceive such flexibility as a benefit and missed the structure of 
regular dasses and the support of peers. Students who were not satisfied witfi die delivery sj^tem also 
missed the face to face contact with instructors and peers. In several cases, communication via the computer 
was not perceived as "real" interaction. "1 never saw the teachers.... there was not any interactions. Too 
impersonal," 

The students who were most dissatisfied with the instructional delivery system said they prefer face-to-face 
discussions where they can watch facial expressions. The students from each institution who had the least 
satisfaction said that they are intimidated by computers^ that computer use interferes with their social 
activities, and that they did not have the background skills for the course. None of the most satisfied 
students reported intimidation or social interference, and all but one said that they had die background skills 
for the course. The dissatisfied students self-reported more need for feedback, less adaptability, not viewing 
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the self as studious and as wc»rking carefully, and as thinking too mudt about their Unutations. 
from the ET FA is in Table 3. 
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The data 



Satisfaction wid\ instniction delivered bv hvpercard . While all students reported that the hypercard stack 
helped them learn Test Taking^ strategies and that Aey would use a similar mode of instruction again, 
xesponses to the satisfaction questionnaire indicated ^t five students were satisfied witSt this means of 
instructional ddiveiy and that four students were dissatisfied witii it. Ihexe were two students who 
reported being proficient computer users; both were satisfied users of fee delivery system. The remainder 
of the students self-reported little or no prior awnputcr use. 

Those students with Ute most satisfaction reported that Aey prefer working alone as opposed to working 
in a group, that they are often anxious, and that tihey generally see COTiputer use as being fun. The least 
satisfied students reported just fee opposite. The satisfied students also more frequently reported Aat they 
are curious and exdted about new things, are prepared most of the time, and have a cooperative attitude. 
Table 4 gives the percent of satisfied and dissatisfied students who chose each of the learner 
characteristics." 

A reasonable question to raise is the extent to which the ET PA data from the telecourse and hypercard 
evaluations support one another. A review of Tables 3 and 4 indicate that the students dissatisfied %vife 
either instructional delivery system reported more often than fee satisfied studente feat feey are intimidated 
by computers, have less physical dexterity, are less prepared and studious, work less carefully, have less 
desire to control their own learning pace, and prefer to work in a group than to work alone. 

Inter-rater Reliability; ATP PA 

The inter-rater agreement of the ATD PA is reported in Table 5. The first column gives the percentage of 
raters who gave exactly the same response to a given item and the second column is the statistic described 
earlier. As can be seen from Table 5, items related to the assistive technology itself and use of fee 
technology wifein fee family or workplace received fee highest consistency in ratings. Items concerned %vife 
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user dharacteristics and whether or not that dtaractenstic was an incentive or disincentive to device use 
received slightly agreement sccves. 



Thexe was also some diffexences due to the paiti idar case study. For example, there was generally higher 
agreement among the raters fen- Case B tium for tiie otilter two cases. 



Inter-rater Reliability: ET PA 

Table 6 presents similar information for the FT PA. As can be seen from an inspection of Table 6, ^e 
majority of items were rated exacdy the same by ova half of the raters. Again, ^ere was some variation 
between the two cases and generally Case B received the more consistent ratings. Certain case studies could 
have contained more complete information or simply were less susceptible to ambiguous interpretation. 
Verbal data provided by the participants provided some reasons for differences among the cases and 
suggestioru: for improving the scaling for several items and instruments. 



DISCUSSION 

As the use of assistive and educational technologies increase/ there will be more concern directed towards 
their quality^ selection, and the ways they impact overall quality of life. It is important to be able to analyze 
the constellation of factors serving to influence an individual's predisposition toward technology use or 
non-use so that the most appropriate technology for that person can be provided. The ATD FA and ET PA 
seem to have done a good job of discriminating predispositions to technology use on the part of satisBed 
and less satisfied users. 
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Based on results obtained to date, there are two self-report, easy-io-use checklist instruments available, both 
of which have reasonable validity and inter-rater reliability. The ATD PA and ET PA can be useful: 

* In the earliest stages of matching a pwson with a technology by giving the consumer a means of providing 
direct input into the process of technology selection and making an informed choice, 

* in identifying needed modifications in the technology, 

* in reducing the frustration that often accompanies a poor match between individuals and the technologies 
meant to help them by providing criteria against which to assess the likelihood of satisfied technology use. 
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* and enablii^ persons to detmnine changes in predisp<»itions to technology use cyver time. 

Finally, tihe combined metfiodology of quantitative item analyses and qualitative verbal responses about the 
items proved to be valuable in assessing tiie usefulness of Ae two instruments. The mediodologv also 
demonstrates how tfie reliability and validity of subjective sdf-ieport, dieddbits, instruments designed 
duefly to identify problems, not to develop norming information, can be done in a manner ^t yidds 
meaningful results for the improvement of the instnunents. This can be useful to o^er individuals 
constructing similar assessment instruments for ^^ch, additionally, tfiexe is no odter existing instrument 
against which tiheirs cm be correlated and, thus, one popular method of estaUishing construct validity is 
not possible. 

Copies of the instnunents as well as more complete descriptions of tfieir develoinnent «e available from tfie 
authors. 
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Assistive Technology Influences 



Milieu 



ff^iwnility 



lirchnology 



U Optimal Support from family/peers/ 

employer 

S Realistic expectations ctf family/ 

emplc^w 

E Setting/environment fully 

supports and rewards use 



Proud to use device 

Mc^vated 

Cooperative 

Optimistic 

Good coping dcills 

fttient 

Self-disdpUned 
Generally positive life 

experiences 
Has the skills to use the device 
n?rceivi^ discrepancy between 

desired and current situation 



Goal achieved with no pain, 

fetigue or stress 
Compatible with/enhances the 

use of other techmriogies 
Is safe^ leliaMe, easy to use and 

maintain 
has the desired transportability 
No better options currently 

available 



Rutial/ Ptessure for use from either 

Reluctant family/peers/employer 

Assistance often not available 
Setting/environment discour- 
ages use or maKes use 
awkward 



Embarrassed to use device 

Unmotivated 

Impatient/impulsive 

Unrealistic expectations 

Low self-esteem 

Somewhat intimidated by 
technology 

Technology partially or occa- 
sionally fits with lifestyle 

Deficits in skills needed for use 



Goal not fuOy achieved or 
with discomfort/strain 

Requires a lot of set-up 

Internes somewhat with the 
of other technologies 

Device is inefficient 

Other options to device use 
exist 



N 
O 
N 

U 
5 
E 



Avoidance Lack of support from either 
family/peers/employer 
Unrealhitic expectations of 

others 
A'*^;5tance not available 
Setting/environment disallows 
or prevents use 



R?rson doesn't want it 

Embarrassed to use device 

Depressed 

Unmotivated 

Uncooperative 

Withdrawn 

intimidated by technology 
Many changes required in 

lifestyle 
Does not have skills for use 



hrcewtd lack of goal 
achievement or too much 
strain/discomfort in use 
Requires a lot of set-up 
Berceived or determined to be 
incompatible with the use of 
other technologies 
Too expensive 
Long delay for deliver}* 
Other options to device use 
exiA 



Abandonment Lack erf support from either 
family/peers/employer 

Setting/environment discour- 
ages or makes use awkward 

Retires assistance that is 
not available 



Embarrassed to use device 

Depressed 

Low self-esteem 

Hostile/angry 

Wthdrawn 

Resistant 

I\x>r socialization and coping 
skills 

Many changes in lifestyle with 

device use 
Lacks skills to use device and 

training is not available 



Goal not adueveJ and/or 

discomfort/strain in use 
Is incompatible with the use 

of other technologies 
Has bci^n outgrown 
Is difficult to use 
Device is inefficient 
Repairs/service not timely or 

Affordable 
Other options to use became 

available 
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Tablet 

Variables that Received Significantly Different Mean 
Responses inm Assistive Ustoiing Device Useis and Non-nsexs 



Variable 


Users (n=12) 
Mean S.D. 


Non-users (n=8) 
Mean S.D. 


t value 


Sig 


P*HI 














Performance: Home 


3.30 


.90 


4.01 


.43 


2.28 


.03 


Perfonnance: Adverse 


2.56 


.91 


3.59 


,63 


3.00 


.01 


Maladaptive B^uviors 


2.17 


.41 


1.49 


.27 


-4.52 


.00 


Verba] Strategiies 


3.71 


.64 


2.57 


.68 


-3.77 


.00 


ATDPA 














AHe to Use 


4.64 


1.21 


2.83 


1.60 


-2.41 


.04 


[Hearing] Capabilities 


1.17 


•5S 


2.57 


.78 


4.12 


.00 


Perceived Benefit 


4.50 


LOO 


2.57 


.78 


-4.65 


.00 


Help Goal Achievement 


4.08 


l.OR 


2.29 


.95 


-3.77 


.00 


limits from [Hearing Loss] 


3.00 


1.21 


L86 


1.07 


-2.14 


.05 


Change Way of Doing Things 


3.17 


L34 


1.83 


.75 


-2.70 


.02 


Comfort with Family 


3.50 


.67 


2.86 


.38 


-2.66 


.02 


Comfort with Friends 


3.58 


.52 


3.00 


.00 


-3.92 


.00 


G:>mfort at Work/School. 


3.60 


.52 


3.00 


.00 


-3.67 


.01 


Will Enhance Quality of Life 


4.08 


1.08 


2.14 


.69 


-4.76 


.00 


Satisfaction with Life 


.58 


-52 


.00 


.00 


-3.92 


.00 


Patient & Easy Going 


.58 


.52 


.00 


.00 


-3.92 


.00 


Good Self-image 


.92 


.29 


.00 


.00 


-ll.CK) 


.00 


Has Little Privacy 


.00 


.00 


.71 


.49 


3.87 


.01 


Technology Total 


3.71 


.81 


2.81 


.61 


-2.75 


.02 


Temperament Total 


2.03 


.64 


1.50 


.28 


-2.47 


.03 


Psychosocial Total 


3.81 


.63 


2.91 


.53 


-3.31 


.01 
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0 fittxibook? 

GALLAUDET STUDEKTS 

StiKtom A: I (Wfor t> team ^ tedures, gitnip disoussbns, 

ftntf I9xlbook3. ITrey aO hetp me. I ijk> mrt pmfer 
|u8t one style. 

Student B: 1 pmter to Bston a lecture beemise the teacher 

explains it more ctearty. You get Bmted 
infomtatlon from a book. 

StudentC: i prnfertoUstenio a tecture. TTie teacher exptakis 

th^dearm^. K I have any questiens the teacher 
can darHy. Alto, the tracher can acM Interestfng 
into to the diseuaston and the toctufe. 

Student D: the bito is more compBcated, then I prefer a 

tectuFB 80 the teadier can exptain everything 
ctoarty. But the topic b moie aocial, then I can 
read it from a t)OOk and undemtaml. 

11H. Do you piofer to woric alone or wtlli a gfoop? 

QALLAUDET STUDENTS 

Student A: I prefer both. I prefer to read atone. But I prefer to 

have dfseu8Sk>ns in a group. 

Student B: I feel nwB oomfortsdlxto worldr^ atone. I dont 

know why, just prefer ft that way. I have more time 
and can (ocms more too. 

Student C: I prefer to wor1( atone, tt takes too much time to 

d^ss things, cooperate and solve problems. I 
prefer {ust nty opinton. 

Student D: i prefer to work atone. Othenwise people in a 

group share too much. E prefer to do what I want 
to do and whatever f feel tike. 



NTtD/Rrr STUDENTS 

Student E: I think f would learn fwt as mt^ from a lecture- 

styto wRh this professor. But wm> other Profs, K 
may be better wRh reading a test 

Student F: Ustening to a lecture. 

Student Q: It dq>erKte. Son^tfmes I pnsfer a lecture; other 

times I prefer reedlrv a book. 

Student H: Both. The lacture explains thtogs» then the book 

goes bito moredetaQ. 

Student I: I prefer to road a textoook. 

Student J: i pnsfer them both plus open group discusstons. I 

(tont like fust one way. They are all beneficiaL 



NTiD/nrr students 

student E: I prefer to work atone, tarn a oonsctonttous worker 

ar^ pnstor to be nesponsEbto for It 

Student F: With a group. 

Student G: tt depends again. Sometimes i prefer working with 

a group. 

Student H: I prefer atone. But I will parttotpate In group 

discusatons. 

Student t: f prefer to work atone. I grew up abne and I am 

very Independent t can tocus a tot eaator if I am 
atone. 

Student J: f prefer to do Indivkfual wodc. ft wastos my time 

working in a group. Although. I can share within a 
class, I preter to work atone 



lit Do you prefer to watch a demiMistraton or expertment cm your own. 
GALLAUDET STUDENTS 

Student A: f prefer to participate. I feel more comfortable that 

way. 

Students: I wcuki partic^ate a llttie. But I feel mors 

comfortable watching. Maybe H t partlc^ate t wHI 
learn more sometimes. But I feel more comfortable 
watohlng. 

Student C: t prefer to parttolpato becatme I learn more from 

other students. But ft depends on the course. In 
English dass. tor exampto. I prefer to work atone. 
But If I have to do some public speaking, then I 
prefer with a group so we can discuss ideas. 

Student D: I prefer to sit back arKt watch othem. I hate to t>e 

involved with others. I doni know why. 
Involvement in sports is fine but school is more 
boring. 



NTlD/RfT STUDENTS 

StudAnt E: I prefer being involved. 

Student F: tt depends K i am interested or not If I am 

interested, then I will partic^to. But if I am not 
Inlerested, then I prefer to watch others do It 
ir^stead. 

Student 6: I like to watoh first Then I like to help others after 

I see what Is wrong. 

Sti^entH: tllke to be involved. It Is more challenging. 

StiKJent I: I prefer to work on my own afxl watoh what others 

are doing. 

Student J: I prefer both. For example. I witi sit and watoh first 

what is goin^ on. Then I wilt pantoipate. 
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T«Mo3 

Otarsctafistics of ^enis Who Wora Satisfiod or CHsMtefled with Totoooi^mroing 



I am ouftoua and axdtad about new things 
I »motimw naad fraqwnt teodback 
I aomoftnes fe^ bnimidalsd by oomputam 
I am impatoni 

I aoGOpt my taacHar^ mMce about a oouise 

I aometimas am oasiV dtstrsctod 

I rdoolva crfti^m wed 

I faal oortfklant 

I am aomatimas oasiV borad 

I move from task to aaaHy 

My physica) daxtortty is good 

Most of the tima 1 am prepared 

I (Sea to havo the teacher^ attantton 

I vmiid da8cr9t>e myaeif as atudkHis 

I aomettmea faol anxious 

t oftan want to irark atowar/rastar than the rest 

f have a oooparafiva attHude 

Compuiar use oftan intarfaras with my sociat activftlas 

I work carefuHy 

t am aomatimas critical 

I prefer to work atone 

I hBV& the background skills for this course 
t beKeve using a oomputar is (un 
I am nnotivatad to team 

f sorT>etimes think too much about my limitations 
I want to control my own teaming pace 
t think rm nexibte 

I sometimes need frequent reinforcement 
i work with precision 
I think rm adaptable 

i prefer to watch a demonstration than l[> experinrtent on my own 
i prefer to read a textbook than to listen to a taachsr*s lecture 
I prefer to work in a group than to work alona 



^tund)er(and Pwton^^rf^udentB Choosing 
Adleettye to Dea^tie Ihemse Ves 



»nts 



7) 

6|B6%) 
4(57%) 
0 

1(15%) 
6(86%) 
3(43%) 
3(43%) 
3(43%) 
3(43%) 
4(57%) 
3(43%) 
4(57%) 
4(57%) 
3(43%) 
5(71%) 
3(43%) 
5(71%) 
0 

3(43%) 

4(57%) 

5(71%) 

6(86%) 

5(71%) 

5(71%) 

2(29%) 

5(71%) 

6(86%) 

2(29%) 

1(15%) 

6(86%) 

(20%) 

1(15%) 

1(15%) 



lente 



3) 

3/100%) 
3(100%) 
3(100%) 
0 

1(33%) 
2(67%) 
2(67%) 
2(67%) 
2(67%) 
2(67%) 
1(33%) 
1(33%) 
2(67%) 
0 

3(100%) 
2(07%) 
2(67%) 
2(67%) 
0 

2(67%) 
1(33%) 
0 

2(67%) 
3(100%) 
3(100%) 
2(67%) 
3(100%) 
1(33%) 
1(33%) 
1(33%) 
2(67%) 
0 

2(67%) 
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(^>amctortsiics Numbsr (and Pere«n^ of Students Owoslng 







■^»— — — fUritfl n ft 

^iiaaattsitaQ 








1 am curious and exctod fl^out now things 


5(100%) 


S(50%) 


1 6Mi9times neod frsquem fMdba^ 


3(60%) 


2(50%) 


1 somatimas foe! bnimidatad by oomputarB 


0 


1(25%) 


1 am fmpatiant 


3(60%) 


1(25%) 


i aocqpt my taachariB advica ateut acauma 


1(20%) 


1(25%) 


1 aomatimas am aasRy d btractad 


3(60%) 


2(50%) 


I rscaiva altfcism watt 


3(60%) 


2(50%) 


1 faal confidant 


5(100%) 


3(78%) 


1 am aomatbDas aasHy borad 


4(80%) 


2(50%) 


1 movafnom teak to task aasiiy 


4(60%) 


8(75%) 


My physicd) daxltority is good 


4(80%) 


2(50%) 


Most of it)0 tima 1 am pnaparad 


4(80%) 


1(25%) 


1 Oka to hava tha taachar^ attantton 


4(80%) 


2(50%) 


1 lioukf daserfl^ nryself as stud^ia 


1(20%) 


0 


1 acHnatimas faal anxbua 


5(100%) 


0 


1 pftan want to woric slower than tha rsst 


2(20%) 


1(25%) 


1 hava a cooparativa attitude 


5(100%) 


2(50%) 


Computar use often intarferaa with my social activitias 


0 


0 


1 work carefully 


4(60%) 


2(50%) 


1 am somatimas criticaf 


2(40%) 


2(50%) 


1 pratof to work atone 


4(80%) 


1(25%} 


1 hava ^ background skfl^ for this course 


3(60%) 


2(50%) 


1 baSava using a computar is fun 


5(100%) 


2(50%) 


t am motfvatad to faam 


3(60%) 


1(25%) 


f aometrmas think too much about my HmHattons 


1(20%) 


0 


f want to control my own leamlna pace 


3(60%) 


1(25%) 


1 thtnk rm fiexS>fe 


3(60%) 


4(100%) 


1 somatimas need aquent rarnforcamant 


0 


1(25%) 


1 work with precis^ 


1(20%) 


1(25%) 


1 think t'm adaptable 


4(80%) 


3(75%) 


t prefer to watch a denrionstratton than to exparfmant on my own 


0 


0 


1 prafar to ro^ a textbook than to listen to a taachar^s lecture 


1(20%) 


2(50%) 


1 prefer to work tn a group than to work atone 


1(20%) 


3(75%) 
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Tables 

Inter-ratsr Agrsemsnt for the Three AID PA Cases 

Mean Deriaiion 

Item % Agreement Fiom Mode 
ABC ABC 



4-pc^t scale: 





680 


70.4 


435 


.40 


.56 


.87 




G5A 


88.9 


35.0 


.35 


.26 


1.25 




X 


90.0 


56.3 


X 


.30 


.63 




^6 


84.6 


60.9 


.15 


.39 


.52 




80.0 


88.9 


43.5 


.20 


.30 


1.34 


suDDrat S8tvioes/traixune 


56.5 


75.0 


36* S 


.61 


.46 


1.00 


3-ooint ftcalp* 














Status with DCers 


60.0 


66-7 


39.1 


.40 


.52 


-61 


family 


100.0 


55.6 


73.9 


.00 


.44 


.30 




64 0 


556 


43 5 


.36 


44 

• • * 


.78 


self 


48.0 


63.0 


63.6 


.52 \ 


.37 


-41 




44.0 


41.7 


42.9 


•36 


•S6 


-76 


fits with lifestyle 


44.0 


43.5 


36.4 


*56 


.56 


.90 


independent of assistance 


75.0 


92.0 


63.6 


.38 


.08 


.59 


pyrilAfi AtiA in rrnifrnl 


39.1 


62.5 


87.0 


.83 


.46 


.13 
















inrpntivP' RunrvirtiVP others 


65.2 


42.9 


50.0 


.78 


1.33 


1.67 


coODefdtive attitude 


30.4 


33.3 


27.8 


1.70 


1.76 


2.17 


independence 


34.8 


33.3 


22.2 


1.61 


1.81 


2.39 


work/school 


39.1 


38.1 


27.8 


1.87 


1.57 


1.61 




34 8 


28.6 


33.3 


1.26 


2.52 


1.50 


PtiVianrprl niiAlitv of lifp 


30.4 


23 8 


55.6 


2.13 


1.52 


.83 


self^disQDline. patience 


34.8 


28.6 


44.4 


1.34 


2.52 


1.28 


incni'ooration of disabilitv 


34.8 


66.7 


38.9 


2.30 


1.04 


1.72 


^ iiwi utujuuuuiicru 


52 2 


47.6 


33 3 


1 26 


1.71 


1.83 


positive outlook 


26.1 


33.3 


27.8 


1.34 


1.33 


1.78 


disincentive: depression 


31.6 


35.3 


47.1 


1.89 


1.82 


1.18 


unrealistic expectations 


31.6 


35.3 


41-2 


1.68 


1.82 


1.65 


poor self-concept 


26.3 


41.2 


47.1 


2.42 


1.23 


1.53 


hostility 


42.1 


41.2 


35.3 


1.05 


.88 


1.77 


soda! withdrawal 


42.1 


47.1 


35.3 


.89 


1.12 


1.77 


focuses on barriers 


31.6 


47.1 


41.2 


1.89 


.65 


1.11 


poor coping sldlls 


21.1 


29.4 


41.2 


2.42 


1.41 


2.06 


resistant 


63.2 


35.3 


35.3 


1.68 


1.47 


2.18 


will interfere socially 


26.3 


41.2 


41.2 


1.63 


1.18 


1.89 



no soda) integration 
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Tables 

Intei^rater Agre^ent for the Two ET PA Cases 



Item 



% Agreement 
A B 



Avg. deviation 
firosn mode 
A B 



5-point scale: 

goal agreement 
appropriate technology 
niatchcs content aspects 
trihiyi^ical donands 
instmction in M modality 
txaiidn^support needed 
j^deience materials availaUe 
ease of set up, use 
support peiB<mnel 
able to purchase w rent 

yes/no option: 

curious & exdted 

impatient 

receives criticism 

moves frcan task to task 

needs teacher's full attention 

pace ctf work 

works with precision 

badkground Knowledge 

focus on liniitations 

student omtrols learning pace 

for xeinfon^ment 
accepts teacher's advice 
confidence 

physical/sensory needs 
studious 

has intellectual abilities 
critical 

able to operate 
sees as fun/helpful 
flexible adaptable 
imtimidatea 
distrectable 
bored 
prepared 
anxious 

needs one-on-one 
cooperative 
interferes sodaJly 
pliers to work alone 
motivated 

5-point scale: 

family encouragement 
status 

independent of assistance 
accessibility 



56.5 
39.1 
34*8 
78.3 
45.5 
31.6 
37.5 
78,3 
38.1 
59.1 



91.3 

69.6 

56«5 

60.9 

100.0 

69.6 

87.0 

65.2 

95.7 

73.9 

78-3 

69.6 

52.2 

87.0 

52.2 

91.3 

91.3 

73.9 

69.6 

65.2 

95.7 

87,0 

91.3 

87.0 

52.2 

95.7 

78.3 

65.2 

100.0 

91.3 



95.7 
34.8 
52.4 
54.5 



73,9 
36.4 
36.4 
78.3 
43.5 
55.0 
47.1 
55.6 
47.4 
83.3 



52.2 
95.7 
95.7 
69.6 
91.3 
95.7 
91-3 
87.0 
73.9 
100.0 
87.0 
82.6 
73.9 
82.6 
69.6 
100.0 
91,3 
95.7 
73.9 
78.3 
91.3 
100,0 
100.0 
82.6 
78.3 
91.3 
82.6 
69.6 
95.7 
95.7 



56.5 
47.8 
55.0 
57.9 



.57 

.87 

.91 

.26 

.72 

1.00 

1.00 

,30 
1,23 

.54 



.08 
.30 
.43 
.39 
.00 
.30 
.13 
.34 
.04 
.26 
-21 
.30 
.48 
.13 
.48 
.09 
.09 
.26 
.30 
-34 
.04 
.13 
-09 
.13 
.48 
.04 
.21 
.34 
.00 
.09 



.04 
.87 
.95 
.59 



.34 
,90 
.68 
.26 
.87 
.80 
.82 
.50 
1.58 
.28 



.48 
.04 
.04 
.30 
.09 
.04 
.09 
.13 
.26 
.00 
.13 
.17 
.26 
.17 
.30 
.00 
.09 
.04 
.26 
.21 
.09 
.00 
.00 
.17 
.21 
.09 
.17 
.30 
.04 
.04 



.69 
.82 
.70 
.47 
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Protocol for the Student Post-course Interview 

RTT/Gallaudet University Project on the Instructional 
Application of Computer Conferencing Technology 

M. Scherer, FaU '91 

The interview is a^-tnded mi loosely famudated so that as much tmdirected information can be elicited as possibk. The (^ect 
is to facilitate rather Ifcuis to direct the responses. 



Name Date^ 

Sttutent is ^deaf hearing 

Major_ 



This past quarter you took a course [Black Civil Ri^ts in Ae Twentieth Century/Mass Media and Deaf History], This 
was me first time this course was taught throu^ telecommunications and interactive computer dialoging with students 
here and at Gallaudet University. 

We are very interested in learning how tfus course wcnrked out for you and learning your opinions on how to make tttis 
course and others taught in the same way better, I have just a few questions to ask you. 

1. Why did you register for this particular course? 
Any other reasons? 

2. Please think back to your first group meeting about this course. What did you expect it to be like? 

3. How did your expectations and opinions of it change over the quarter? What do you think most changed your 
opinion? 

4L Overall are you glad that you took this course as far as its content is concerned? Why or why not? 

5. How well do you believe you achieved the goals of the course? 

6. Are you glad that you took it as far as the way it was taught? Why or why not? 

7. How was this method better or worse than the traditional classroom style of learning as far as you^ yourself, 
are personally concerned? 

Better: 

/ 

Worse: 



8. Please tell me about what this course was like for you as far as the need to work independently and with no 
traditional classroom interaction, 
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9. What did you do to stnicture and pace tite coursework in order for you to meet tihe course requirements? 

10. Please describe your interactions with: 

1. The cottxse instmctors 

2. The resource person 

11. Rease tell me what you learned most bom this course about: 
1. The content of tihe course 

Z Your attitudes toward the subject matter of this course 

3. Your instructors and peers 

4. Your leaning st]^e and needs (Probes: Did you leam easily using this method? Is this a metiiod which 
you would use again? Do you prefer to leam from listening to a lecture ot by reading a textbook? Do 
you pilfer to work alone or wim a group? Do you prefer to watd\ a demonstration or experiment on 
your own?) 

12. What future applications do you see for courses taught this way? 
Any others? 

Now please look at tiNis page listing a variety of student characteristics, nease drde all the statements that describe 
you. (Hand student next page). 



?4 
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Student Characteristics of 



(Please print your name) 



Please CIRCXE ALL statesnents thaS describe jom 



I am curious and 
excited about new 
things 

I am impatient 



I receive criticism 
weB 

I move from task to 
task easily 

I like to have the 
teacher's attention 

I often want to work 
slower/faster than 
the rest of die dass 



I work carefully 



I sometimes need 
£iequent feedback 



I accept my teadier's 
advice about a course 

I feel confident 



My physical dexterity 
is good 

I would describe 
mysdf as studious 

I have a cooperative 
attitude 



I am sometimes critical 



I sometimes feel 
intimidated by 
computers 

I sometimes am 
easily distracted 

I am sometimes 
easily bored 

Most of the rime 
I am prepared 

I »>merimes feel 
anxious 

Computer use 
often interferes 
with my sodal 
activities 

I prefer to work 
alone 



I have the background 
skOIs for this course 

I sometimes think too 



I sometimes need 
frequent reinforcement 

I prefer to watch a 
demonstration than to 
experiment on my ov^ 



I believe using a 
computer is fun 

I want to control my 



I work with precision 



I prefer to read a 
textbook than to listen 
to a teacher's lecture 



I am motivated to 
leam 

I think I'm 
flexible 

I think rm 
adaptable 

I prefer to work 
in a group than 
to work alone 



Please list other characteristics that describe you as a learner in this course: 



Interviewer Notes and Impressions: On attached sheet 

(Include studenf s level of comfort^ general affect^ assessment of genuineness, and such problems as distractions during 
the interview, communication difficulties^ etcj 
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Questionnaire on Using the Study Skills Program 



Nanie_ . Date 

Majo r ^ 

We want to know if tftis computer program helps you learn. Flease answer tiie following questions. 

1. Have 3rou ever used a computer program lor leamii^? 
If so, did you like it? Why? Why not? 

2. How is tiWs method better or worse for you than traditional classroom teaching? 

3. Hease list three things you liked about this computer pn^ram. 

1) 
2) 
3) 

4. Hease list tfvee tiungs you did not like about this computer program. 

1) 
2) 
3) 

5. Did you like working independently (no teacher, no peer group)? Why or why not? 

6. Please tell me what you remember most for this material: 

a. What was it trying teach you? 

b. How much interest do you have in the material now? 

c. Is this a method you would use again? 

d. In your opinion, how do you leam best? 

7. What advice do you have for teachers diinking about teaching material this way? 
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(Please print your name) 

Wl^SfB^ ORCXE ALL staieasenis that describe you: 



1 am cuiious and 
exdted about new 
tfun^ 


I Bcmietimes need 
frequent feedback 


I sometimes feel 
intimidated by 
computers 


I am impatient 


I accept my teadter's 
advice about a course 


I sometimes am 
^ily distracted 


I tecffive criticism 
wen 


I feel confident 


I am sometimes 
easily bored 


I move from task to 
cask easily 


My physical dexterity 
is good 


Most of tfie time 
I am prepared 


I Uke to have the 
teadier's attention 


I wculd describe 
myself as studious 


I scnnetimes feel 
anxious 


I often want to work 
slowo'/faster than 
the rest of the dass 


I have a cooperative 
attitude 


Computer use 
often interferes 
with my sodal 
activities 


1 work carefully 


I am sometimes critical 


I prefer to work 
aione 


I have the background 
skills for this course 


I believe using a 
computer is fun 


I am motivated to 
leam 


I sometimes think too 


I want to control my 


I think Fm 
flexible 


I sometimes need 
frequent reinforcement 


I work with precision 


I think rm 
adaptable 


I prefer to watch a 
demonstration than to 
experiment on my own 


I prefer to read a 
textbook than to listen 
to a teacher's lecture 


I prefer to work 
in a group than 
to work dime 



Please list other characteristics that describe you as a learner in this course: 



Interviewer Notes and Impressions: (on attached sheet) 

[Include student's level of comfort, general affect, assessment of genuineness^, and such problems as distractions during 
the interview, commtmication difficulties, etc.l 
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